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ABSTRACT 
3.ej 


Based  on  arbitrarily  right-densored  observations  tram  a 
probability  density  function  f  ,  the  existence  and  uniqueness  of 
the  maximum  penalized  likelihood  estimator  (MPLE)  of  f^  is 


"of  a 


proven.  In  particular,  the^first  MPLE  of  Good  and  Gaskins' 
density  defined  on  [0,®)  is  shown  to  exist  and  to  be  unique 

under  arbitrary  right-censorship.  Furthermore,  the  MPLE  is  in 
the  form  of  an  exponential  spline  with  knots  at  the  observed  cen¬ 
sored  and  uncensored  data  points.  ✓  — 

'  f  -Mj 

/1.  INTRODUCTION 

The  problem  of  nonparaaetrlc  probability  density  estimation 
has  been  studied  for  many  years.  Summaries  of  results  for  com¬ 
plete  (uncensored)  random  samples  have  been  listed  by  Tapia  and 
Thompson  (1978),  Vertz  and  Schneider  (1979),  and  Bean  and  Tsokos 
(1980),  for  example.  Also,  a  review  of  results  for  censored 


3 


samples  has  been  given  by  Padgett  and  McNichols  (1984).  In  addi¬ 
tion  to  its  importance  in  theoretical  statistics,  nonparametric 
density  estimation  has  been  used  In  hazard  analysis,  life  testing, 
and  reliability,  as  veil  as  In  the  areas  of  nonparametrlc  discrim¬ 
ination  and  high  energy  physics  (Good  and  Gaskins,  1971)  • 

One  approach  to  estimating  a  density  function  nonparametri- 
cally  is  that  of  maximum  likelihood.  Nonparametrlc  maximum  like¬ 
lihood  estimates  of  a  probability  density  function  do  not  exist  in 
general.  That  is,  the  likelihood  function  for  a  complete  sample 
is  unbounded  over  the  class  of  all  possible  densities,  However, 
by  suitably  restricting  the  class  of  densities,  a  nonparametric 
maximum  likelihood  estimator  (MLE)  may  be  found  within  the  restric¬ 
ted  class.  For  complete  samples,  the  maximum  likelihood  estimator 
of  a  density  g  was  given  by  Barlow,  Bartholomew,  Bremner  and 
Brunk  (1972)  if  g  was  assumed  to  be  either  decreasing  (nonin¬ 
creasing)  or  unimodal  with  known  mode.  Vegman  (1970a, b)  assumed 
unimodality  with  unknown  mode  and  found  the  MLE  of  the  density  and 
studied  its  properties  for  complete  samples.  McNichols  and  Padgett 
(1982)  studied  the  nonparametric  MLE  of  monotonic  or  unimodal  den¬ 
sities  based  on  arbitrarily  right-censored  observations.  Even 
within  the  class  of  decreasing  (or  unimodal)  density  functions, 
however,  when  the  largest  observation  was  censored,  McNichols  and 
Padgett  (1982)  had  to  restrict  their  estimator  to  a  finite  interval 
[0,T]  where  T  was  an  arbitrarily  large  positive  number,  greater 
than  the  largest  observation. 

Another  approach  to  the  problem  of  nonparametric  maximum 
likelihood  estimation  of  a  density  from  complete  samples  was  pro¬ 
posed  by  Good  and  Gaskins  (1971).  This  method  allowed  any  smooth 
integrable  function  on  the  interval  of  interest  (a,b)  (which  may 
be  finite  or  infinite)  as  a  possible  estimator,  but  added  a 
"penalty  function"  to  the  likelihood.  Tbe  penalty  function  penal¬ 
ized  a  density  for  its  lack  of  smoothness,  so  that  a  very  "rough" 
density  would  have  a  smaller  likelihood  than  a  "smooth"  density, 
and  hence,  would  not  be  admissible.  De  Montricher,  Tapia,  and 
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Thompson  (1975)  showed  that  the  natural  mathematical  setting  for 
the  solution  of  the  maximum  penalized  likelihood  estimation  (MPLE) 
problem  of  Good  and  Gaskins  (1971)  was  provided  by  the  Sobolev 
subspaces  of  the  Hilbert  space  LjW,  the  square- integrable  func¬ 
tions  on  the  real  line  R.  They  proved  existence  and  uniqueness 
results  for  the  MPLE.  Later,  Klonlas  (1982)  obtained  the  strong 
consistency  of  the  MPLE  of  the  density  function  in  appropriate 
norms.  He  also  derived  the  "first  MPLE  of  Good  and  Gaskins"  for 
the  case  that  the  density  g  has  support  only  on  the  half  line, 
essentially  by  reflecting  g  around  zero  and  using  results  for 
g  having  support  R. 

In  this  paper  ve  obtain  existence  and  uniqueness  results  for 
the  nonparametric  MPLE  of  a  density  g  based  on  arbitrarily 
right-censored  observations  from  g.  General  results  are  first 
obtained  for  densities  with  support  ft  c  R  and  penalty  function 
$  and  then  the  problem  of  "Good  and  Gaskins'  first  MPLE"  is  con¬ 
sidered  for  arbitrarily  right-censored  data  observed  on  R.  The 
existence  and  uniqueness  results  are  then  obtained  for  densities 
g  with  only  positive  support  by  using  a  symmetry  argument,  re¬ 
flecting  g  about  zero,  and  then  utilizing  the  general  results 
for  support  R.  It  is  also  shown  that  the  MPLE  16  an  exponential 
spline  with  knots  at  the  data  points. 

2.  MOT ATI ON  AND  BASIC  DEFINITIOKS 

Let  ft  c  R  be  a  finite  or  infinite  interval  and  let  f° 

denote  a  probability  density  function  with  support  in  ft.  Let 

X?,...,X^  be  n  independent  identically  distributed  random 
I  n  o  0 

variables  with  common  density  f  .  Later,  X^,  i*l,...,n,  will 

be  interpreted  as  the  true  survival  times  of  n  items  or  indi¬ 
viduals  under  observation,  where  f°  will  have  support  in  [0,®). 

Suppose  that  D. ,D_,...,U  is  a  sequence  of  constants  or  random 

12  n  o 

variables  which  "censor"  X^,  1*1,..., n,  on  the  right.  In  sur¬ 
vival  analysis  or  reliability  studies,  the  U^'s  represent 
possible  "loss"  times  of  items  or  individuals  from  the  test. 


The  observed  data  are  denoted  by  the  pairs 
1*1,,.., n,  where 


<V4i> 


9 


Xi  •  ain{xJ,U1}t  t± 


( 1  ±f  xj  S  u± 

I  0  if  xj  >  u1 . 


It  is  desired  to  obtain  the  MPLE  of  f°  based  on  these  observa¬ 
tions. 

o 

In  reliability  or  survival  analysis,  where  f  has  support 

in  [0,®),  the  nature  of  the  censoring  depends  on  the  U^’s. 

(1)  If  U,  are  fixed  constants,  the  observations  are 

i.  n 

time  truncated.  If  all  U^'s  are  equal  to  the  same  constant, 

then  the  case  of  Type  I  censoring  results,  (ii)  If  all 

U.  m  iP.  the  rth  order  statistic  of  X?,...,X®,  then  the 
i  (r)  —  i  n 

situation  is  that  of  Type  II  censoring,  (iii)  If  U, ,..«,U 

1  n 

constitute  a  random  sample  from  a  distribution  H  (usually  un¬ 
known)  and  are  Independent  of  X?,..«,X^,  then  (X. ,L. ),  i*l,...,n, 

in 

is  called  a  randomly  censored  sample.  See  Gill  (1980,  Ch.  3  and 

Ex.  4.1.1)  for  further  discussion.  An  observed  value  of  (X^Aj) 

will  be  denoted  by  (x. ,d.). 

P  *  ^ 

By  L  (ft)  ve  will  mean  the  space  of  functions  v  such  that 
/flJv  (t)|Pdt<®  with  norm  ||vjjp  *  f/n|v(t)  (pdt]ly,p  for  p  i  1. 
Let  H(ft)  be  a  manifold  in  L*(ft). 

Following  notation  similar  to  that  of  De  Montricher,  Tapia, 
and  Thompson  (1975),  let  $  denote  a  functional  H(ft)  -*■  R. 
Given  the  arbitrarily  right-censored  sample  (z^,d^),  i«l,2,...,n, 
the  ^-penalized  likelihood  of  v  e  H(ft)  is  defined  by 


n  d  l-di 

L(v)  «  U  (v(x  ))  1  [1-V(x  )]  exp(-4>(v)), 

i-1  x  x 

*i 

where  VOO*  /  1  v(t)dt  denotes  the  cumulative  distribution 

function  with  density  v  and  0  is  the  penalty  function.  By 
the  maximum  penalized  likelihood  estimator  (MPLE)  of  f°  corres¬ 


ponding  to  manifold  B(ft)  and  penalty  function  we  will  mean 
any  solution  to  the  problem: 
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maximize  L(v)  subject  to  (2.2) 

v  «  H(ft),  / ^  v(t)dt  ■  1,  and 
v(t)  2  0  for  all  t  e  0. 

The  function  L(v)  is  the  censored  form  of  the  penalized  likeli- 

hood  of  Good  and  Gaskins  (1971) . 

When  H(Q)  is  a  Hilbert  apace,  a  natural  penalty  function 

to  use  is  $(v)  *  ||  v  | ]  ,  where  ||*||  is  the  norm  on  H(fl) .  If 

no  reference  is  given  to  $  when  we  are  considering  the  MPLE 

corresponding  to  a  Hilbert  a  pace  B(Q),  it  is  assumed  that  <p  is 

the  square  of  the  norm  on  H(H).  A  Hilbert  space  inner  product 

will  be  denoted  by  <•»•>  so  that  <v,v>  ■  ||v|j  .  When  H(H)  is 

a  Hilbert  space,  it  is  a  reproducing  kernel  Hilbert  space  (RKHS) 

if  point  evaluation  is  a  continuous  operation,  that  is,  vq  v 

in  H(.Q)  implies  that  v  (t)  v(t)  for  all  t  e  fl.  See 

n 

Goffman  and  Fed  rick  (1965)  for  further  details. 

3.  EXISTENCE  AND  UNIQUENESS  OF  AH  MPLE 

In  this  section  we  establish  the  existence  and  uniqueness  of 
a  solution  to  problem  (2.1)  when  B(ft)  is  a  RKHS.  The  inner 
product  on  H(H)  is  defined  by  <u,v>  ■  u(t)v(t)dt  for 
u , v  e  H(n). 

Theorem  3.1.  Assume  that  H(R)  is  a  RKHS,  integration  over  (2 

is  a  continuous  functional,  and  D  is  a  closed  convex  subset  of 

{v  e  H(J2):  v(x^)  i  0,  i*l, . . .  ,n}  with  the  property  that  D  contains 

at  least  one  function  which  is  positive  at  the  data  points 

o 

x. ,...,x  .  Then  the  MPLE  of  f  corresponding  to  penalty 
i  a  2 

function  $(v)  «  ||v||  in  (2.1)  exists  in  D  and  is  unique, 

where  ||»||  denotes  the  norm  on  H(fl). 

Proof ;  Since  B(ft)  is  a  RKHS,  by  the  continuity  property, 

for  each  1*1, 2,.,., n  there  exists  a  constant  such  that 

|v(x  )|  S  K  || v ||  .  It  follows  that 
*  *  d  1  ■  d 

L(v)  «  JI  (v(x.)]  1  (l-V(x.)J  1  exp(-  |{v II 2  ) 

i-1  1  x 


where  k 


s  n  [k  II v | !  3  «*P(-  ||v||2  > 

i-i  1 

-  ||v||k  exp(-  I! v|| 2  )(  u  K  ), 

i-1  1 

n 

■  £  d  is  the  number  of  uncenspred  observations.  The 

■  Xk  exp(-X^),  X  >  0,  is  bounded  above  so  that 


function 

L(v)  s  C,  where  C  is  a  constant. 

Let  H  -  sup{L(v):  v  e  D).  From  the  hypothesis  of  the 


theorem,  M  >  0.  There  exists  a  sequence  {v^}  c  D  such  that 


L(v^)  «*■  M  as  J  ®.  Also,  since  Q(X)  -*-0  as  X  -*■  ®  and  L(v) 
is  bounded,  ||v  ||  S  for  all  J,  where  is  a  constant. 

Nov,  the  set  {v  e  H((2):  ||v||  £  C^}  is  weakly  compact,  so  {v.} 


contains  a  weakly  convergent  subsequence  also  denoted  by  {v^}. 
Let  v*  denote  the  weak  limit  of  {v^}.  Since  H(&)  is  a  RKHS , 


vj(xi>  -*■  v*(«4)  for  each  i-l,2,...,n.  The  norm  is  a  continuous 


convex  functional  and,  hence,  i6  weakly  lover  semicontinuous. 


Thus,  lim  inf  |} 1 1  i  ||v*||  .  Since  integration  is  a  continuous 
functional  by  hypothesis, 

W  *  Jjo  ^(Odt  -  v*(t)dt  -  v*(xA) 


for  all  x  ,  i»l,...,n.  Therefore, 
1  d 


1-d , 


lim  II  [v  (x,)]  1  Jl-V  (x  )]  1  exp(-  ||v  ||2 ) 

j-»oo  i«i  J  A  J  1  J 

n  d.  1-d.  , 

S  n  [v*(xi)J  1[l-V*(x1)J  «p(-  ||v*j|Z )  -L(v*). 


i-1 


Thus,  M  S  L(v*).  Since  D  is  closed  and  convex,  it  is  weakly 
closed,  so  that  v*  e  D.  Therefore,  a  maximizer  of  L(v)  exists 
in  D. 

Since  M  >  0,  we  can  consider  maximizing  J(v)  over  D, 


J(v)  •  In  L(v) 

n  n 

-  I  d  In  v(x  )  ♦  J  (1-d  )ln!l-V(x  )]  -  <v,v>. 


where 


The  first  Frechet  derivative  of  J(v)  is  (Tapia,  1971) 


n  n  v(x  )  I 

J'(v)(n)  •  -  J1<1-di)n(x1>  [1^7  j  -  2<v'ri>- 


and  the  second  Frechet  derivative  i6 


J"(v) (n,n) 


din2^xi^ 

v2(x±) 


-  2<n,n>. 

Since  J"(v)  is  negative  definite,  J  i6  strictly  concave  by 
Proposition  16,  page  157  of  Tapia  and  Thompson  (1978)  and,  hence, 
can  have  at  most  one  maximizer  on  a  convex  set.  Therefore,  there 
exists  a  unique  solution  to  (2,1)  in  D.  Ill 

We  note  that  the  constraints  in  (2.1)  define  a  closed  convex 
subset  of  {v  e  H(fl)j  v(xi>  2  0,  i*l,...,n}.  Also,  let  (a,b)  be 
a  finite  interval.  For  each  integer  s  *  1,  let  H®(a,b)  denote 
the  Sobolev  space  of  functions  on  [a,b)  whose  s-1  derivatives 
are  absolutely  continuous  and  vanish  at  a  and  b  and  whose  s th 
derivative  is  in  L  (a,b).  The  inner  product  on  HQ(a,b)  is 
defined  by 

<u,v>  -  u(s)(t)v(s)(t)dt, 

where  u*8^  denotes  the  sth_  derivative.  It  is  well  known  that 
H8(a,b)  is  a  RKHS  with  the  above  inner  product  and  integration 
over  (a,b)  is  a  continuous  operation  (Lemma  2.1  of 
De  Montricher,  Tapia,  and  Thompson,  1975). 

Corollary  3.1.  The  MPLE  corresponding  to  S*(a,b)  with  4(v)  - 

2  u 
<v,v>  ■  || v  1 1  exists  and  is  unique. 

As  a  special  case  of  Corollary  3.1,  ve  can  consider  the  MPLE 
of  a  lifetime  density  f°  over  a  finite  interval  10,T)  for 
very  large  T  >  0  based  on  an  arbitrarily  right-censored  sample 
from  f°.  The  MPLE  exists  and  is  unique  in  H®(0,T)  with 


s  s 


penalty  function  $(v)  -  jJ  [v(,)(t)]2dt.  The  extension  to  [0,®) 
is  considered  in  the  next  section, 

4.  THE  FIRST  ESTIMATOR  OF  GOOD  AND  GASKINS  UNDER  CENSORING 

For  complete  samples,  Good  and  Gaskins  (1971)  considered  the 
penalty  function 


“  0  fL  dt* 

for  a  >  0,  which  is  equivalent  to 

De  Montricher,  Tapia,  and  Thompson  (1975)  indicated  that  the 
underlying  manifold  for  the  MPLE  with  this  penalty  function  should 
be  v 2  e  H  (-®,®) ,  where  H  (-®,®)  is  the  Sobolev  space  of  func¬ 
tions  f :  R  -*•  R  such  that  the  first  derivative  f'  exists  almost 

2 

everywhere  and  f,f'  e  L  (-“,»)  with  inner  product 
<f.g>  -  ^  f(t)g(t)dt  +  12,,  f '(t)g’(t)dt. 

Letting  u  *  v  ,  we  have  the  penalty  function 


$(u2)  *  4a  [u'(t)]2dt,  u  e  H1^-®,®). 


This  substitution  avoids  the  nonnegativity  constraint  in  problem 

(2.1). 

For  the  data  (x^/d^),  i“l,...,n,  described  in  Section  2,  we 

now  would  like  to  maximize 

L(u)  -  n  (u2(x  ))  il/“  u2(t)dt]  iexp(-4a  || u*  ||»  ). 
i-1  i 

Since  L(u)  2  0,  maximizing  L(u)  is  equivalent  to  maximizing 

L(u)  •  (L(u)]  .  Thus,  we  have  the  problem: 

-  n  ?  (1-d  )/2  . 

Maximize  L(u)  -II  {u(x.)J  (/"  u^(t)dtj  exp (-2a  J| u*  JL  ) 

i-1  •  * 


subject  to  r  u^(t)dt  ■  !• 


(4.1) 
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Letting  J(u)  *  In  L(u),  problem  (4.1)  is  equivalent  to; 

S 

Maximize  J(u)  -  I  d  In  u(x  ) 

1-1  1  1 

+  I  -(l-d.)lnir  u2(t)dt]  -  2a/ee<B[u’(t)]2dt 
1-1  1  1 

subject  to  r  u  (t)dt  -  1. 


(4.2) 


Theorem  4.1.  Problem  (4.2)  has  a  unique  solution  in  the  set 

S  *  {u  c  H^(-°°,®)  :  u2(t)dt  -  l). 

Proof ;  Taking  Frechet  derivatives  of  J(u)  gives 
n  n(x  )  n  n(x.)u(x  ) 


where  ^(x^)  -  u2(t)dt,  and 
*  2 

n  X]  (x.)  n 

J"(u)  (n.n)  --Id.  - rAr  -TO 


n  0  (x.)  n  ,  U„(x  )  +u  (x  ) 

J"(u)(n.0)  “"Id  ~~s  -  I  (1-d  )r/(x  )  - r-i- 

i-1  1  uCV  i-1  1  1  (u2(Xi))^ 

-  tri’(t)]2dt. 

Since  J"(u)(n,n)  <  0  for  T\  ^  0,  J(u)  is  negative  definite. 
Hence,  J  is  strictly  concave,  and  by  Theorem  2,  page  160,  of 
Tapia  and  Thompson  (1978),  J(u)  has  at  most  one  maximizer  in 


the  set 


S'  -  {u  €  H1(-w,®);  f°  u2(t)dt  S  l). 


If  J(u)  is  continuous  on  S',  by  Theorem  4  on  page  162  of 

Tapia  and  Thompson  (1976),  J  will  have  at  least  one  maximizer 

in  S'. 

Since  H^(-®,®)  is  a  RKHS,  if  u  u  as  m  -*•  ®  in 

m 

then  u  (x.)  u(x. )  for  each  1-1,  ...,n.  Also, 
ml  i 

||  u  -  u||  «*  0  as  m  -*•  •  implies,  by  definition  of  the  norm  in 
Ir  (-•,•),  that  || u  -  u  |L  -►  0  and  ||u*  -  u'  ||  _  -*•  0  as  m-*  •. 

D  A  O  A 

Furthermore,  for  any  fixed  constant  c,  f*  u2(t)dt  f"  u2(t)dt 

•c  m  *  c 

as  «•*  «.  Bence,  J:  S'  -*■  R  is  continuous.  Therefore,  J(u) 


has  a  unique  maximizer  u^  in  S'. 

Next,  suppose  that  u2(t)dt  <  1.  Since  uj(t)  •*  0  as 

t  •»  then  U|,(t)  and  u^(t)  both  converge  to  zero  as  t  -*•  ®. 

Thus,  there  exists  a  number  M  such  that  uj(t)  <  1  for  t  >  M. 

Consider  a  function  v^(t)  defined  so  that  (i)  v.(t)  -  u  (t) 

*  ^  * 

for  t  <.  M,  (ii)  v^(t)  >  u*(t)  for  t  >  M  and  v2(t)dt  -  1, 
and  (iii)  (v^t)]2  S  Iu;(t)]2  for  t  >  M.  Then  by  (i)  and 
Ciii),  /^Jv;(t)]2dt  -  /llu;(t)]2dt  and 
Ci  K<t)]2dt  *  /Jv;(t)]2dt.  Also,  by  (ii)  ,  for  each  x^, 

1*1,..., n,  v^(t)dt  >  u  (t)dt.  These  results  imply  that 
i 

J(u*)  <  J(vA),  a  contradiction,  since  u^  is  the  unique  maximizer 
of  J  in  S'.  Therefore,  u^(t)dt  *  1,  completing  the  proof. 

Ill 

Now,  we  assume  that  f°  is  a  lifetime  density  on  the  half- 
line  R+  *  (0,®)  and  use  a  symmetry  argument  about  zero  to  obtain 
the  results  for  f°.  Thus,  assume  that  the  censored  sample 
(Xi«Ai)»  i*l,...,n,  is  such  that  X±  >  0  with  probability  one. 
Then  the  problem  (4.1)  becomes: 

Maximize  L(u)  • 

i-1  *  *i 

*  exp[-2a/^(u’(t))2dt],  (4.3) 

»rfiere  >  0,  i-l,...,n,  f^u  (t)dt«l,  and  u(t)  i  0,  t  >  0. 


n  di  r®  2  H(l-d  ) 

n  [u(x,)j  ii r  u  (t)dt]  1 


Let  X 


-i 


X^  and  d_^  *  d^,  1*1,..., n,  and  define 


u(x)  •  u(!x|)  for  x  e  R\{0)  and  u(0)  •  lim  u(x).  Then 

_ _  A  ’ 


X+O 


define  the  following  problem; 

n  <3.  _  2  >s(l-d.) 


Maximize  L<u)  •  II  [u(x  )]  i[f°  u2(t)dt] 

|i  |-1  *i 

x  «*Pl-2o/^(S,(t))2dt], 


(4.4) 


wher*  Co o«2(t)dt  -  2  and  u  c  H_  5.{g  e  H2(-®,®)  :g(x)  *g(-x)}. 


Notice  that  L(u)  ■  [L(u)3  .  Also,  He  is  equivalent  to  the 
1  ® 

Sobolev  space  H  (0,®). 


Preposition  4.2.  If  u*  solves  (4.4),  then  v*(t)  •  u*(t), 
t  a  0,  end  u*(t)  -  0,  t  <  0,  solves  (4.3), 

*  -  k 

Proof :  Suppose  u*  solves  (4.4).  Since  L(u)  ■  [L(u)]^ 
snd  u*  is  synsnetric  ebout  zero  implies  that  /^[u*( t))^dt  •  1, 
u*  solves  (4.3).  Ill 

From  Proposition  4.2,  the  "first  MPLE  of  Good  and  Gaskins" 

2 

under  arbitrary  right-censorship  vill  be  given  by  (u*)  (t) .  We 
next  show  that  this  solution  exists  and  is  unique. 

Theorem  4.3.  Problem  (4.3)  has  a  unique  solution. 

Proof:  h„  defines  a  closed  convex  subset  of  H*(-“>,“>). 
Thus,  by  a  proof  similar  to  that  of  Theorem  4.1,  problem  (4.4) 
has  a  unique  solution.  By  Proposition  4.2,  u*  is  the  unique 
solution  to  problem  (4.3).  Ill 

The  next  theorem  shows  that  the  MFLE  from  (4,3)  has  the 
general  form  of  an  exponential  spline  with  knots  at  the  observed 
data  points. 

Theorem  4,4.  The  unique  solution  u*  of  problem  (4.4)  is  an 
exponential  spline  with  knots  at  the  observed  values  x^ 
i  »  +  1  ,Hh2,...,+n. 

Proof :  For  given  X  >  0  and  a  in  (4.1),  let  #^(u)  “ 
2af"°  [u'(t)]^dt  +  xf*  u^(t)dt  and  consider  the  problem: 

n  _  d±  Jsd-d.) 

Maximize  L.(u)  -  II  [u(x  )]  [J~  u2(t)dt) 

x  lil-i  1 

x  exp[-^(u)]f  (4.5) 

subject  to  u  €  Hg  and  /°°_  u^(t)dt  ■  2. 

The  inner  product  <u,v>  »  2af*  u'  (t)vf(t)dt  +  Aj^ju(t)v(t)dt 

—CD 

defines  a  norm  ||ul!x  *  $^(u)  equivalent  to  the  original  norm  on 
H* (■-»,*>).  Let  denote  the  representex  in  the  ^-inner 

product  of  the  continuous  linear  functional  given  by  point  evalu¬ 
ation  at  xi#  that  is  ■  t|(*i>  for  all  n  <  hW>. 


Let  S  ■  {v  t  Hgt  v(x^)  i  0}.  Then  S  is  closed  and  convex. 
Letting  J x  “  In  L^,  we  have  the  first  and  second  Frlchet 
derivatives, 

n  d  ri(x.)  n  u(x,)l 

Ji(ttXri)  "  l  - - -  l  (1-d  )n(x  )  tt-tA  -  2<u,n>x 

A  lil-1  u(x  )  |i|-l  1  1  l  W  J 


d  <v,  .Tp* 


u(x.)<v  .n>, 


V  i  1*  A  f  n  .  .  v  i/  A 

/  _  i  (l“dj)  u  /j.  \  ”  2<u,ri>., 

lil-1  u  (x . )  1  W 


where  U^x^)  S  “2(r^dt*  and 

n  d  n(x  )t](x  ) 

JV(u)(n)  ■  -  I  -jLrFi - - 

A  |i  |-1  u(x±) 

n 

-  I  (l-d  )n(x.)n(x.) 
lil-1 


U2(xi)+u2(x1) 


-  2<n,n>x- 


2 

Thus,  due  to  the  nonnegativity  of  the  functions,  i  2  ||n||  x 
so  that  -Jx  is  uniformly  positive  definite  relative  to  S.  This 
implies  that  is  uniformly  convex  on  S.  Therefore,  if  we 

can  show  that  is  continuous  on  S,  by  Theorem  6,  page  162 

of  Tapia  and  Thompson  (1978),  will  have  a  unique  maximizer 

in  S. 

By  an  argument  similar  to  that  in  the  proof  of  Theorem  4.1, 

if  u  -*■  u  in  H_  as  m  -*■  then  u  (x.)  -►  u(x.)  for  each 
m  a  0  l  1 

x^  and  \\Zm  -  u||x  0  as  m  ■+  «.  Thus  Iju^  -  u||2  0  as 

m  -*■  •  and  as  before,  for  any  fixed  constant  c, 

rt  *  re  =2  (t)dt  as  m  -*•  ®.  In  particular,  for  c  -  x^ 

thi6  convergence  holds.  Therefore,  is  continuous  on  S,  and 

has  a  unique  maximizer  in  S. 

Nov,  at  the  solution  u^,  we  must  have  the  gradient  of 
vanish,  that  is, 

n  d.v  n  u.(x  )v 

l  :riJ-  -  l  W1>  c  Y»~T  -  Jux  •  0 

*  *  |1|-1  ux(*i)  lil-1  V 

where  U2X^xi^  *  ^x  Hence» 
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d  v 
li 


I  - 

liT-1  u. (x.) 


XV<V 


n 


(1-d^ 


“><»i)vi  i 

'WV  J 


(4.6) 


In  order  to  obtain  the  form  of  in  (4.6),  front 

<vt,h>x  -  n^),  we  have 

2 af^m  V^(t)n'(t)dt  +  XJl  vi(t)n(t)dt  -  n(xi)  .  (4.7) 

Integrating  the  left-hand  side  of  (4,7)  by  parts  (in  the  distri¬ 
bution  sense)  gives 

-2a/^oori(t)v^(t)dt  +  X/^*  vi(t)n(t)dt  -  n^) 
or 

/^[^(t) -2av"(t)]n(t)dt  -  /^oo6i(t)n(t)dt,  (4.8) 

where  fi^t)  *  6Q(t-xi)  and  6^  denotes  the  Dirac  delta  function, 

that  is,  /^B>d0(t)n(t)dt  -  n(0).  Equation  (4.8)  is  equivalent  to 
the  differential  equation 


Xv^t)  -  2av"(t)  -  6i(t) 


(4.9) 


which,  for  i-0,  has  the  solution 

(2aX)  -  exp | 


v0(t) 


Js  —t-(H>lsltl).  t*°- 

Now,  v^(t)  •  v^(t-xi)  +  v^t+x^)  solves  (4.9),  Substituting 
v^  into  (4.6)  gives  the  unique  solution  u^  in  the  form  of  an 
exponential  spline, 

d. 


V° 


1(2aX)-*5  |  l  - ~  [exp(-(X/2a),s|t-x.|) 

(lil-1  ux(x±) 

+  exp (-(X/ 2a)  **1 t+x^ | ) ] 

n  (1-d  )ux(x.)  , 

",  l  ~  u"TxT~  I«P(-a/2o),5|t-x  |) 

lil-1  U2XUi;  1 

+  exp(-(X/2a)>5|t+xi|))  |  . 


(4.10) 


Nov,  notice  that  over  the  constraints  in  problem  (4.4), 
problems  (4.4)  and  (4,5)  have  the  same  solution  for  any  X  >  0 


v. 


fBo  -2 

since  /  u  (t)dt  is  constant.  We  need  to  show  that  the  unique 

solution  to  (4.4),  u*.  Is  also  an  exponential  spline. 

Let  g(u)  ■  f°_  u2(t)dt  and 

n  n  . 

G(u)  -  l  d.  In  u(x  )  ♦  I  i(l-d.)ln  U,(x.) 

llT-1  1  1  lit-1  21  21 

-  2a/^soiu'(t)32dt. 

Then  from  Lagrange  multipliers,  there  exists  X  so  that  u* 
satisfies  the  equation 

G ' (u)  -  Xg*(u)  »  0  and  g(u)  »  2, 
n  d.rt(x.)  n  u(x  )u(x  ) 

l  - — I  a-d.)  ■J-f-'T-  -  4aH  u*(t)n,(t)dt 

liT-1  G(Xi)  lil-1  1  U2lV 

-  2 x£,  u(t)n(t)  -  0.  (4.11) 

2 

Using  L  gradients  in  the  sense  of  distributions,  (4.11)  is 
equivalent  to 


n  d.  (1-d  )u(x.)  1 


+  4auM  -  2Xu  •  0 


and  g(u)  *  2. 


(4.12) 


Since  (4.4)  has  a  unique  solution,  (4.12)  must  also  have  a  unique 
solution  in  Hg,  namely  u*. 

Now,  if  X  S  0,  then  any  solution  of  the  first  equation  in 
(4.12)  would  necessarily  be  a  sum  of  trigonometric  functions  and 
would  not  satisfy  the  constraint  g(u)  ■  2  since  the  integral 
g(u)  would  not  exist.  Thus,  X  >  0.  Also  G(u)  -  Xg(u)  * 

Jx(u),  so  that  u*  must  solve  (4.5)  for  this  X  and  therefore 
has  the  desired  form,  an  exponential  spline  with  knots  at  the 
data  points.  Bence,  the  proof  is  complete.  /// 

The  unique  solution  to  problem  (4.3)  is  then  u*(t)  “  u*(t), 
t  >  0,  from  (4.10).  Hence,  the  "first  MPLE  of  Good  and  Gaskins" 

i.  fT.  *  \  2 
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5.  CONCLUSION 

In  this  paper  ve  have  ahown  Che  existence  and  uniqueness  of 
the  MPLE  of  a  density  function  in  an  appropriate  general  mathe¬ 
matical  setting,  based  on  arbitrarily  right-censored  observations 
from  that  density.  For  the  first  penalty  function  of  Good  and 
Gaskins  (1971),  the  existence  and  uniqueness  of  the  MPLE  of  the 
density  function  on  (0,®)  was  also  shown  for  this  type  of  data. 
This  "first  HPLE  of  Good  and  Gaskins"  under  arbitrary  right-cen¬ 
soring  was  shown  to  be  in  the  form  of  an  exponential  spline  with 
knots  at  the  observed  censored  and  uncensored  values*  These 
results  are  analogous  to  the  complete  sample  case,  except  that  the 
form  of  the  penalized  likelihood,  and  therefore,  the  HPLE,  is 
complicated  by  the  terms  involving  the  survival  function, 

Statistical  properties  of  the  MPLE  under  censoring  have  not 
been  considered  here.  The  consistency  and  other  statistical  re¬ 
sults  will  be  investigated  in  a  later  paper. 
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